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METHOD AND DEVICE FOR LATERAL ADJUSTMENT OF IMAGE 

This patent application is based on and claims priority to U.S. Provisional Patent 
Application Serial No. 60/455,151, filed March 17, 2003. 
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Cross Reference to Related Applications 

This patent application is related to U.S. Patent Application Docket No, 944- 
003.170-1, assigned to the assignee of the instant application, and filed even date 
herewith. 
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Field of the Invention 

The present invention relates generally to an optical component for forming an 
image in an imaging device and, more specifically, to the stabilization of the image, 
which is caused to shift laterally on the image plane by hand motion or other vibrations. 

15 

Background of the Invention 

When taking a still image, a series of still images or video images using an 
imaging device, such as a camera, a camcorder, a video recorder, a mobile phone or the 
like, the user's hand may shake, causing the image formed on the image plane to shift 

20 laterally. The shift could bliu* the image. The shift can be caused by the tilting of the 

camera, or the lateral movement of the camera. Figure la shows the tilting of the camera 
due to the hand motion. As shown, the images of different parts of the scenery are 
formed on the same part of the image sensor. If the tilting angle is small, the shift is more 
or less equivalent to that caused by a lateral movement of the camera. 

25 It is advantageous and desirable to stabilize the image in order to improve the 

viewing quality. Typical stabilization methods in the prior art can be divided into two 
types: one is based on software and one is based on a special optical device. The software 
method is applicable when the camera uses a solid-state imaging device such as CCD or 
CMOS for image formation. With the software method, the size of the CCD or CMOS 

30 imager must be larger than the size of the actual image for viewing or for recording so 
that the image can be effectively shifted using a real-time image processing technique to 
collectively move the pixel coordinates fi"om one location to another. The software 
method is illustrated in Figures 2a and 2b, which show the same image is formed on a 
different part of the image sensor at different times due to hand motion. 
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With the other image stabilization method, it requires that at least one optical 
component of the imaging lens system be mechanically shifted in the x-y direction, as 
shown in Figure lb. The mechanical movement of the lens component involves complex 
and expensive mechanical structures. 
5 In a mobile phone with limited image capability, the prior art method for image 

stabilization using software is impractical because a mobile phone in general is limited in 
its memory and image processing power. A mechanical structure is also undesirable 
because it is costly and requires space for implementation. 

It is advantageous and desirable to provide a method and device for image 
10 stabilization without using a large image sensor or a movement mechanism to move the 
optical components in an imaging device. 

Simunarv of the Invention 

The present invention uses electrowetting (EW) technology to shift laterally an 
15 image formed on an image plane. Accordingly, the present invention uses a liquid droplet 
as a lens and uses an electric field to change the shape of the liquid droplet for image 
shifting. 

The first aspect of the present invention is a method for stabilizing an image 
formed in an imaging device, wherein the image can be caused to shift in a plane by 
20 movement of the imaging device, said method comprising the steps of: 

providing a deformable lens in the imaging device, said deformation lens having 
an optical axis, the optical axis at legist partially determining a location of the formed 
image in the imaging device, and 

applying an electric field on the deformable lens for causing a change in the 
25 optical axis so as to compensate for the shifting of the image in the plane caused by the 
movement of the imaging device. 

According to the present invention, the electric field is achieved by two electrode 
layers, said method fiirther comprising the step of: 

sectioning at least one of the electrode layers into a plurality of electrode areas so 
30 as to allow a voltage applied to one of said electrode areas to be different from a voltage 
applied to at least another one of said electrode areas. 
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According to the present invention, the deformable lens comprises a liquid droplet 
disposed on a substrate adjacent to one of the electrode layers, such that the contact angle 
of the liquid droplet with substrate is caused to change be the electric field. 

According the present invention, the method further comprises the steps of: 
5 computing the image shift in the plane; and 

determining the applied electric field based on the image shift. 
The second aspect of the present invention provides an optical component for use 
in an imaging device for shifting an image formed on a plane of the imaging device, the 
optical component having an optical axis at least partially determining a location of the 
10 formed image in the imaging device, said optical component comprising: 
a compartment having: 

a first side and an opposing second side; 
a substrate on the first side; 

a deformable lens comprising a droplet of a first liquid having a first 
15 refi-active index disposed along the optical axis on the substrate; and 

a second liquid disposed in contact with the droplet, the second liquid 
having a second refractive index different from the first refractive index; 
a first electrode layer disposed adjacent the first side of the compartment; and 
a second electrode layer, disposed in a cooperative relation with the first electrode 
20 layer, for providing an electric field on the deformable lens when a voltage is applied to at 
least the first electrode layer, wherein the first electrode layer is effectively divided into a 
plurality of electrode areas to receive the voltage so that the electric field on the 
deformable lens can cause a change in the optical axis. 

According to the present invention, the second electrode layer is disposed adjacent 
25 to the second side of the compartment. 

The third aspect of the present invention provides an imaging device having an 
optical axis and an image plane for forming an image on the image plane at a location at 
least partially determined by the optical axis, said imaging device comprising: 
a voltage source; and 
30 an optical compartment having: 

a first side and an opposing second side; 
a substrate on the first side; 
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a deformable lens comprising a droplet of a first liquid having a first 
refractive index disposed along the optical axis on the substrate; and 

a second liquid disposed in contact with the droplet, the second liquid 
having a second refractive index different from the first refractive index; 
5 a first electrode layer disposed adjacent to the first side of the compartment, the 

first electrode layer operatively connected to the voltage source; and 

a second electrode layer, disposed in a cooperative relation with the first electrode 
layer, for providing an electric field on the deformable lens when a voltage is applied to at 
least the first electrode layer, wherein the first electrode layer is effectively divided into a 
10 plurality of electrode areas to receive the voltage so that the electric field on the 
deformable lens can cause a change in the optical axis. 

The fourth aspect of the present invention provides a portable device, which 
comprises: 

a voltage source; 
15 an imaging sensor array; and 

an image forming module having an optical axis and an image plane substantially 
on the imaging sensor array for forming an image on the imaging sensor array at a 
location at least partially determined by the optical axis, said image forming module 
comprising: 

20 an optical component comprising: 

a first electrode layer operatively connected to the voltage source; 
a deformable lens disposed along the optical axis adjacent to the 
first electrode layer; and 

a second electrode layer, disposed in a cooperative relation with the first 
25 electrode layer, for applying an electric field on the deformable lens, wherein the 

first electrode layer is effectively divided into a plurality of electrode areas so that 
the electric field applied on the deformable lens can cause a change in the optical 
axis. 

According to the present invention, the portable device further comprises: 
30 an image processor, operatively connected to the imaging sensor array for 

receiving signals indicative of the image formed on the imaging sensor array, for 
determining a shift of the image location due to movement of the portable device, 
wherein the image processor is also operatively connected to the voltage source for 
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providing a signal indicative of the image shifting to the voltage source so as to allow the 
voltage source to adjust the electric field such that the optical axis is changed to 
compensate for the image shifting due to the movement. 

According to the present invention, the image processor comprises a software 
5 program for computing voltage levels on the electrode areas so as to allow the voltage 
source to adjust the electric field based on the voltage levels, and the software program 
comprises a code for determining a shift of the image location based on the signals 
received fi-om the imaging sensor array. 

The portable device comprises a mobile terminal or the like. 
10 According to the present invention, the deformable lens comprises a droplet of a 

first liquid having a first refi^active index, and wherein the optical component fiirther 
comprises an optical compartment, the compartment having: 

a first side and an opposing second side, the first side adjacent to the first 
electrode layer; 

15 a substrate on the first side for disposing the deformable lens; and 

a second liquid disposed in contact with the droplet, the second liquid 
having a second refractive index different from the first refractive index. 

The fifth aspect of the present invention provides a software product for use in an 
20 imaging device, the imaging device having an optical axis and an image plane for 

forming an image on the image plane at a location at least partially determined by the 
optical axis, the imaging device comprising: 
a voltage source; and 
an optical component comprising: 
25 a first electrode layer operatively connected to the voltage source; 

a deformable lens disposed along the optical axis adjacent to the first 
electrode layer; and 

a second electrode layer, disposed in a cooperative relation with the first electrode 
layer, for applying an electric field on the deformable lens, wherein the first 
30 electrode layer is effectively divided into a plurality of electrode areas so that the 

electric field applied on the deformable lens can cause a change in the optical axis. 
The software product comprising: 

a code for determining a motion-induced image shift on the image plane; and 
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a code for determining a plurality of voltage levels based on the image shift for 
providing a signal indicative of the voltage levels to the voltage source so as to allow the 
voltage source to provide the voltage levels to the plurality of electrode areas for causing 
the change in the optical axis in order to compensate for the motion-induced image shift. 

5 

The present invention will become apparent upon reading the description taken in 
conjxmction with Figures 3 to 10. 

Brief Description of the Drawings 
10 Figure la is a schematic representation illustrating an image can be blurred by 

hand motion. 

Figure lb is a schematic representation illustrating mechanical movement of an 
optical component is used to compensate the image shifting due to hand motion. 

Figure 2 is a schematic representation illustrating a large image sensor being used 
15 for image shifting on the image plane. 

Figure 3 is a cross sectional view illustrating a liquid lens, according to the present 
invention, and the effect of lens deformation. 

Figure 4 is a cross sectional view illustrating the equivalent effect in image 
shifting due to lens deformation. 
20 Figure 5 is a schematic representation illustrating the implementation of a liquid 

lens in an imaging device. 

Figure 6 is a schematic representation illustrating one way of sectioning an 
electrode. 

Figure 7 is a schematic representation illustrating another way of sectioning the 
25 electrode. 

Figure 8 is a schematic representation illustrating yet another way of sectioning 
the electrode. 

Figure 9 is a schematic representation illustrating an image stabilization method, 
according to the present invention. 
30 Figure 10 is a schematic representation illustrating a portable device that uses the 

image stabilization method, according to the present invention. 
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Detailed Description of the Invention 

The present invention uses a hquid lens for image shifting. A voltage control 
system is used to deform the liquid lens in an asymmetrical way. The present invention 
uses electrowetting (EW) technology to provide the required liquid lens. In EW 
5 technology, a droplet of liquid is placed on a substrate to function as a lens. The contact 
angle of the droplet is usually a function of the surface tension of the liquid under the 
influence of the surface properties of the substrate. When an electric field is applied to 
the liquid droplet, the electric field modifies the surface tension at the liquid-solid 
interface, causing a change in the contact angle (see Figure 3, contact angle is changed 
10 from 0 to 0'). The change in the contact angle causes a change in the surface curvature of 
the droplet. 

EW technology is known in the art. Kroupenkine et al (EP 1 271 218 Al) 
discloses disposing a liquid droplet on a substrate as a liquid lens having a focal length 

15 and applying a voltage on the liquid droplet in order to change the focal length. 

Kroupenkine et al. also discloses having a plurality of electrodes adjacent to the liquid 
droplet and applying different voltage potentials on the electrodes so as to move the liquid 
droplet from one location of the substrate to another. Kroupenkine et al. describes how 
the contact angle is changed in terms of applied voltage. Berge et al (U.S. Patent No. 

20 6,369,954 Bl) discloses having a chamber filled with a first liquid and a drop of second 
liquid, and applying a voltage on the electrodes surrounding the chamber so as to change 
the focal length of the liquid drop. Onuki et al, (EP 1 069 450 A2) also discloses having a 
chamber filled with a first liquid and a drop of second liquid, and applying a voltage so as 
to change the focal length. Onuki et al. additionally discloses that the height of the 

25 chamber is limited so as to change the focusing properties of the liquid drop when the 

applied voltage exceeds a value. Feenstra et al (WO 03/069380 Al) discloses having a 
cylindrical compartment filled with a first fluid and a second fluid, wherein the fluid 
contact layer of both the first and the second fluids has a cylindrical inner wall. 

As previously mentioned, the key feature of the present invention is that the 

30 deformation on a deformable lens is asymmetrical relative to the optical axis of the lens. 
In order to achieve an asymmetric deformation on the liquid lens, an asymmetrical 
electric field is applied on the liquid droplet. The lens system 100 of the present 
invention is shown in Figure 3. As shown, a liquid droplet 200 is placed on a substrate to 
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function as the deformable lens. The substrate is part of a sealed chamber 110, which is 
filled with a different liquid 220. The refi-active indices of the liquid lens 200 and the 
Hquid 220 are n\ and W2, with «i>W2 so that the droplet functions as a positive lens. For 
illustrative purposes, the asymmetrical electric field is denoted by Ei and E2 on different 
5 sides of the optical axis (O.A.). The electric field can be achieved by three electrodes 
120, 122 and 124. It is understood that these electrodes are sufficiently transparent so 
that the lens system 100 can be used for imaging purposes. As shown in Figure 3, the 
electrode 120 and the electrode 122 are operatively connected to a first voltage source Vi, 
and the electrode 120 and the electrode 124 are operatively connected to the voltage 

10 source V2. If the resulting electric fields Ei and E2 are not equal, then the surface 

curvature on one part of the liquid droplet is different firom the surface curvature on the 
other part of the liquid droplet. As a result, the optical axis of the liquid droplet may shift 
JBrom O.A. to O.A'. If the lens system 100 is used in an imaging system (see Figure 5, for 
example), then the image formed by the imaging system is caused to shift accordingly. 

15 For illustrative purposes, the resulting image shift can be treated as if the liquid droplet 
200 is moved laterally, as shown in Figure 4. 

The liquid lens 200, as depicted in Figures 3 and 4, can be used as the only 
element of the imaging optics, but it can also be one of a plurality of components in the 
imaging optics. For example, the lens system 100 can be used together with lens Li and 

20 lens L2 to form an optical system 150, as shown in Figure 5. The optical system 150 can 
be used to form an image on the imaging sensor array 300, which is located on the image 
plane (an x, y plane, see Figure 6) of the optical system 150. In principle, the optical 
system 150 is equivalent to the lens system as shown in Figure lb. 

In order to compensate for the image shift in both x and y directions in the x, y 

25 plane, it is desirable to have at least four electrodes 125, 126, 127 and 128, as shown in 
Figure 6, operatively connected to potentials Vi, V2, V3 and V4, (relative to a common 
electrode 120 in Figure 3, for example). To allow for a finer control of the shift in the 
optical axis, it is possible to arrange a larger number of electrodes connected to potentials 
Vi, . . ., V6, as shown in Figure 7. As shown in Figure 7, the electrodes are arranged like 

30 pie sections in a circular pattern. Similarly, a large number of electrodes can be arranged 
in a rectangular array as shown in Figure 8. 

In order to carry out the invention, it is advantageous to use an imaging processing 
unit to monitor the amount of shifts in the jc, y directions, for example. As shown in 
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Figure 9, the image processing unit 20 is operatively connected to the solid-state imaging 
array 300 to receive signals 310 indicative of the image formed on the solid-state imaging 
array 300. Based on the signals, the image processing unit 20 measures the shift amount 
(Ax, Ay) due to movement or jitter of the imaging system. A software program 18 is used 
5 to compute the appropriate voltages for different electrodes in the lens system 100 based 
on the shift amount (Ax, Ay) of the image on the image plane. The image processing unit 
20 is also operatively connected to a voltage control module 30 and provides a signal 21 
indicative of the appropriate voltages to the voltage control module 30. The voltage 
control module 30 applies different voltages 31 to the electrodes in order to cause the 

10 deformation of the liquid lens so as to compensate for the vibration-induced image jitter. 
The software program may include a code for computing the shift amount (Ax, Ay). 

The image stabilizer, according to the present invention, can be implemented in a 
small imaging device, such as a mobile phone, or a camcorder or other hand-held imaging 
devices. Because of the simplicity of the stabilizer, it can be used in rough conditions. 

15 As shown in Figure 10, the optical system 150, according to the present invention, is 

implement in a portable device 1 for imaging purposes. The device 1 further comprises an 
imaging sensor array 300 for image acquisition. A power supply 20 and a voltage control 
module 30 are used to cause the non-uniform deformation of lens system 100 (see Figure 
9). It is advantageous to have a display 10 so as to allow a user to see the image formed 

20 on the imaging sensor array 300. 

It should be noted that the drawing figures as shown in Figures 3 to 10 are for 
illustrative purposes only. For example, the shape of the electrodes and their arrangement 
can be different fi-om those shown in Figures 6 to 8. The electrodes can be triangular or 
hexagonal, for example, so they can be arranged differently. Furthermore, the electrode 

25 areas can be equal or non-equal to each other. 

Thus, although the invention has been described with respect to one or more 
embodiments thereof, it will be understood by those skilled in the art that the foregoing 
and various other changes, omissions and deviations in the form and detail thereof may be 
made without departing fi"om the scope of this invention. 
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